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Experimental data with digital masks and a theoretical analysis are presented for an imaging 
scheme that we call time-correspondence differential ghost imaging (TCDGI). It is shown that by 
conditional averaging of the information from the reference detector but with the negative signals 
inverted, the quality of the reconstructed images is in general superior to all other ghost imaging (GI) 
methods to date. The advantages of both differential GI and time-correspondence GI are combined, 
plus less data manipulation and shorter computation time are required to obtain equivalent quality 
images under the same conditions. This TCDGI method offers a general approach applicable to all 
GI techniques, especially when objects with continuous gray tones are involved. 

PACS numbers: 42.30.Va, 42.0.Ar, 42.50.St 
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Since the first "ghost image" was observed with entan- 
gled photon pairs generated by spontaneous parametric 
down-conversion ghost imaging (GI) has become a 
focus of great attention as well as contention. In this 
technique, two spatially correlated beams are used to 
reconstruct the object image. The object beam passes 
through the object and its total intensity is collected by 
a "bucket" detector with no spatial resolution; a reference 
beam that does not interact with the object is measured 
by a pixel array detector. Various radiation sources may 
be employed, including quantum optical, pseudo-thermal 
0, and true thermal light Q, while lensless configura- 
tions Q and even systems using a computer generated 
thermal field with a single bucket detector [j| Q have 
been demonstrated, stirring up a fundamental debate on 
whether GI is an intrinsically quantum phenomenon or 
whether it can be interpreted by classical optics 043- 
This notwithstanding, GI displays great potential be- 
cause it allows imaging of the object in harsh environ- 
ments, e.g. in a scattering medium fioj or turbulent at- 
mosphere [TTI - [l3j . where standard imaging methods fail. 
Com put ational GI may also be used in optical encryp- 
tion [14| . and in ghost holography, where both intensity 
and phase information may be retrieved as well as in 
ghost holography, where both intensity and phase infor- 
mation may be retrieved [l5j |. The disadvantage is that 
very long measurement times are needed, while the visi- 
bility and signal-to-noise ratio (SNR) are low, especially 
with thermal light, which are serious drawbacks for prac- 
tical applications. Although compressed sensing [l6| can 
be used to reduce the number of measurements required 
for image reconstruction, or equivalently, greatly improve 
the image quality for the same number of exposures in 
GI, the corresponding data processing time is also greatly 
increased. 
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Recently, another method called differential ghost 
imaging (dgi) [rzi was demonstrated which can dra- 
matically enhance the SNR of conventional GI, but again 
with a huge amount of measurement data and more com- 
plex computation. Recently, Luo and co-workers et al. 
jlH [l9j reported a technique that they called correspon- 
dence imaging (CI), in which a positive or negative image 
is retrieved by conditional averaging of the reference sig- 
nals; that is, only those reference data that correspond to 
positive or negative intensity fluctuations of the bucket 
signal are selected for simple averaging, without the need 
to multiply by the bucket detector intensity itself. Com- 
pared with conventional GI for the same number of ex- 
posures, the processing time is greatly reduced, since, 
computationally, addition is faster than multiplication, 
whilst fewer frames are required to reconstruct the im- 
ages. Moreover, the SNR of the negative image of CI 
is always better than that in conventional GI, but for 
the positive images it depends on the partition weighting 

In this paper we present another approach that 
we call time-correspondence differential ghost imaging 
(TCDGI), in which the advantages of DGI and CI are 
combined. Classical explanations of the phenomena are 
presented and we show that the image reconstructed by 
TCDGI can be as good as or even better than that 
of DGI, but with less data manipulation required and 
shorter computation times. This feature is a definite ad- 
vantage and represents a step forward towards real prac- 
tical applications. 

The experimental setup, shown in Fig. [TJ is a lens- 
less GI system. A linearly polarized 632.8-nm Hc-Ne 
laser beam is projected onto a ground-glass disk rotat- 
ing at 3 rad/min to produce a field of randomly vary- 
ing speckles, which have an average diameter of Sq ~ 20 
jUm. This pseudo-thermal light is divided by a 50:50 
beamsplitter (BS) into two spatially correlated object 
and reference beams; the former emerges from the ob- 
ject with an intensity distribution of Ib(xb) to be col- 
lected by the bucket detector Db, while the latter ar- 
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rives at the reference detector Dr with a distribution of 
Ir( x r)i where x is the transverse spatial coordinate and 
the suffixes B and R represent bucket and reference detec- 
tors, respectively. Both beams are collected by identical 
charge-coupled device (CCD) cameras (Imaging Source 
DMK 31BU03), of pixel size 4.65 ^m, which are syn- 
chronously triggered by a pulse generator. The area of 
the beams at the object and reference detector planes, 
which arc at the same distance z R = Zr — 215 mm 
from the source, is Af, eam ~ 0.55 mm 2 , and contains 
N sp eckie = A beam /A coh ~ 1400 speckles; where we have 
taken the coherence area to be A co h ~ 8 2 . 

In the experiment, both cameras captured 1.4 x 10 5 
frames with an exposure time of 10 -4 s. A square re- 
gion in each detector array, symmetric relative to the 
BS, of size 160 x 160 pixels was selected, corresponding 
to the size of the object, which was a (virtual) digital 
mask. Two different masks of the same size were used, 
one with strong black-and-white contrast and the other 
with warm gray tones; their intensity transmission func 
tions Ti(x) and T2(x) are shown in Figs. 2(a) and 5(a) 



respectively. To obtain the bucket signal <Sb, we mu 
the matrix of the mask with the corresponding intensity 
values recorded by Db, pixel by pixel, and then sum over 
all the intensities in the chosen region. As in CI [l9| , logi- 
cal filtering is used to divide the reference signals Ir(xr) 
into subsets that satisfy specific conditions, and the im- 
age is then reconstructed by averaging over each subset 
separately, but here for TCDGI, the condition depends 
on the fluctuation of the differential signals. 
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FIG. 1: (Color online) Schematic diagram of the experimental 
setup. 

Our theory adopts a classical formalism in which the 
shot noise is neglected, and we simply set Ib{xb) = 
aI R (x R ) where the factor a exists because of the im- 
balance of the beamsplitter and detectors. 

In conventional GI, the image in terms of T(x R ) is 
obtained by the second-order correlation function of the 
intensity fluctuations of two detectors 0, [2(| 



(6S B 8I R (x R )) ~ C T{x R ), 



(1) 



where C = A coh (I R (xR))(I B {x B )) is a constant, T{x B ) 
denotes the intensity transmission function of the object, 
and the bucket signal of the object arm is defined as Sb = 
/ lB{x B )T{x B )d 2 XB, 8S B = S B ~ (S b ), and SIr(x r ) = 
Ir(xr) - (Ir(xr)}. 



To implement DGI (l7| . which can dramatically en- 
hance the SNR, we need to define the integrated refer- 
ence detector signal Sr = J I R (x R )d 2 x R . The differen- 
tial bucket signal can be written in an operative form as 
5a = Sb — jj^tSr, and the quantity measured is 



5G$(x R ) = (SS a 5Ir(x r )) ~ C 5T(x R ), 



(2) 



in which the fluctuating part is 8T(x R ) = T(xr) — T, 
and T can be expressed as (S R ) / ol(S r ) . 

In the CI experiment [l9|, all the reference frames are 
divided into two subsets according to the sign of 5S R '- 



{Ir(x r )\SS b > 0}, {Ir(xr)\SS b < 0}. 



(3) 



From each of the subsets, the image is then reconstructed 
merely by simple averaging. We can obtain both positive 
and negative images from calculation of the conditional 
averages (Ir(xr)) + and (Ir(xr))_, respectively, which 
can be written as 



tiply {Ir(xr))-_ 



= (Ir(xr)) + (6Ir(x r ))± 
- (Ir(xr)) + (SIr(x r )(1 ± 6S B /\SS B \)) 
~ (I R (x R )) ± (SIr(xr)5S b )/(\5Sb\) 
~ {Ir(x r )} ±C T(x r )/(\5Sb\), (4) 

Here we have assumed that the positive and negative 
frames arc approximately equal in number, and (A/B) ~ 
(A) /(B), as in Ref. [H|]. 

We now divide the reference CCD signals into two sub- 
sets according to the sign of 5S<\ = 5a — (Sa) = S&, 

{Ir(xr)\SS a > 0}, {Ir(xr)\SS a < 0}. (5) 
From Eqs. ([2]) and (|4|), we can thus obtain 

(I R {x R ))t ff (Ir(xr))±C 5T(x r )/(\SS a \), (6) 

where (• • • ) + and (• • • )_ denote the averages of the 
positive and negative subsets, and correspond to the pos- 
itive and negative images of TCDGI determined by the 
sign of SSa- In addition, it can be seen from Eqs. (U) 
and §Q that if we normalize the average of the condi- 
tional reference intensity after deducting the average of 
the reference signals, the image that we reconstruct by CI 
and TCDGI is almost the same as that in conventional 
GI and DGI. However, an even better way to reconstruct 
the image is to average all the normalized information 
from the reference detector but with the negative signals 
inverted: 



diff _ IT /„ \\diff _ 2C ST(X R ) 

(\6Sa\) 



(7) 



where the image is retrieved by only averaging the refer- 
ence data. Compared with DGI, the multiplication pro- 
cess is replaced by a logical filter process followed by sim- 
ple addition, thus computing time is saved. Furthermore, 
TCDGI has a higher SNR than that of straightforward 
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CI, which means that, with the same amount of data, 
TCDGI gives a better image. 

Next we discuss a more general scheme in which the 
selection condition is modified to: 



{Ir(x r )\5Sa > k}, {I R (x R )\6S A < -k}, 



(8) 



where k is an intensity threshold satisfying < k < 
m&x{\5S/\\}. The averages of the reference signals that 
satisfy the threshold conditions are (I R (x R ))±[[ — 

i (l R (x R ) (l ± pfff^)), where /? = N k+ /N 0+ , with 
Nq+ and Nk+ being, respectively, the number of frames 
satisfying SSa > and SSa > k, respectively. The 
expressions (•■•)+/+ an( l ("'}-[- denote the averages 
of the subsets selected by the above two threshold con- 
ditions, and ifc* means plus-or-minus the real number 
greater than +k (or less than —k). Thus, a positive image 
can be obtained by subtracting these two averages: 



(I R (x R ))f + ff - (I R (x R )Wl ~ C ST'(x R ), 



(9) 



where 6T'(x R ) = ST(x R )/(3(\SS A - k\). In corre- 
lation imaging the main time consuming operation is 
the processing of all the big matrices of the reference 
frames, which is unavoidable even in DGI. In our TCDGI 
method, computation time is saved not just because we 
only use part of the matrices, but especially because we 
only need to add these matrices and then perform one 
minus operation, rather than having to multiply all of 
the differential bucket intensity signals one by one with 
the matching reference CCD matrix then take the aver- 
age, as in the DGI protocol. Although the same original 
number of exposures frames must be taken and sorted, 
the sorting process can be regarded as almost instanta- 
neous. For complex gray-scale objects, which we shall 
study below, much more imaging data is required, thus 
the advantage of less processing and computing time is 
even more pertinent. 

We now present the experimental demonstrations of 
the above methods. In the first experiment, we used a 
digital mask which is a widely used standard in imag- 
ing processing [sec Fig. [2(a)] . To compare the quality of 
the images obtained by different methods with the same 
standard, the gray scale of every image is normalized 
within the interval [0, 1]. This is achieved by subtracting 
the minimum element value from each matrix element 
of the image and then dividing the new matrix by the 
maximum element value. Figures 2(b) and 2(c) show 



the images retrieved after averaging over 140000 frames 
by DGI and GI, respectively (gray bars are provided for 
comparison on the right side of each row). In Fig. |2(d)| 
we divide the reference frames into positive and nega- 
tive subsets in accordance with the sign of SS R in Eq. 
^ as in CI and then obtain the image by subtracting 
the negative from the positive average, (I R )+ — (Ir)-- 
Positive and negative images obtained by TCDGI, where 
instead of using <55b, the sign of 5Sa is used to divide 
the reference signals, are shown in Figs. 2(e) and |2(f)| 



respectively; here 69600 frames were taken. Both pos- 
itive and negative images are much better than in GI, 
although there are still blurred striations due to the ro- 
tation of the ground glass plate, which reflect the non- 
constant background (I R (x R )) in Eq. ((4]). If the number 
of frames is large enough, this term will tend to a con- 
stant, and the quality will improve. However, we can 
eliminate the background noise without increasing the 
number of measurements by directly subtracting the to- 
tal average of the reference signals, to obtain (6I R ) + ^ 
and {8I R ) d yt . As we can sec from Figs. 2(g) and |2(h)] 



the background has been almost completely eliminated, 
and both positive and negative images are much better 
and clearer than in all previous methods. 

From Eq. © we can see that, in TCDGI, even if only 
part of the reference signals are chosen according to var- 
ious threshold values, we can still retrieve relatively high 
quality images. Note that there is a one-to-one cor- 
respondence between the intensity threshold k and the 
number of selected frames; the latter decreases as k in- 
creases. The TCDGI images in the bottom row of Fig. 
[5] are reconstructed from different threshold values and 
frame numbers, again obtained by subtracting the neg- 
ative from the positive image, see Eq. ([9]). Figures 2(i) 
to 2(1) are images retrieved for £3 > k^ > ki > ko = 
from 6000, 21 000, 31 500 and 69 600 frames, respec- 
tively, from each SSa > kj and 6Sa < ~h (i = 0, 1, 2, 3) 



section. Although Fig. 2(i) does not appear to have such 
good contrast as in Fig. 2(1) it was reconstructed from 



only 6000x2 frames as compared with 69 600x2. On the 
other hand, the first smallest black square in the top left 
hand corner of the mask is quite visible in 2(i) but al- 
most indiscernible in 2(1) In all cases, subtracting the 



negative frames always gives a greatly improved image, 
with much of the background noise removed. 

To provide a quantitative comparison of the image 
quality obtained by various methods, we define the SNR 
[2l[23l as: 



SNR 



Signal 
Noise 



T (z,j)] 5 



(10) 



where To(i,j) and T(i,j) are the transmission matrices of 
the object mask of size M x N and the retrieved image, 
respectively, and f = (M A)" 1 T o(h j)- Gen- 

erally speaking, we would expect the SNR to improve 
with the number of reference frames averaged over. The 
SN Rs cor responding to fc 3 , k 2 and k 1 in Figs. 2(i)| 2(j) 
and 2(k) are 2.12, 3.21 and 3.24, respectively. But for 
a fair comparison, we should calculate the SNR for the 
same k value. In Fig. [3] we plot the SNR versus number 
of exposures for a threshold value of k = 0. We see that 
the SNR of DGI (stars) and TCDGI (crosses) are almost 
the same, and both are better than that of GI (circles), 
which is in good agreement with the results predicted by 
our theory. The highest points measured by DGI, GI and 
TCDGI correspond to the images in Figs. |2(b)[|2(c)1 and 
2(1)| respectively. 
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FIG. 2: Top row: (a) Digital mask 1. (b) DGI and (c) GI 
images, (d) CI positive minus negative image, {Ir}+ — {Ir}-, 
all from 140000 frames. Center row: (e) Positive TCDGI 
image {I R ) + ff , (f) negative TCDGI image (Ir)™', (g) pos- 
itive TCDGI image minus reference signal average (<5/r}1 , 
(h) negative TCDGI image minus reference signal average 
{SI R ) d y f , all from 69600 frames. Bottom row: TCDGI im- 
ages obtained by (Ir)^/ — (Ir) _JL with different thresholds. 
Number of frames averaged: (i) k 3 , 6000 x 2, (j) k 2 , 21000 x 2, 
(k) fei, 31500 x 2, (1) k = 0, 69600 x 2. 
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FIG. 3: (Color online) SNR vs. number of reference frames. 



To demonstrate the advantages of TCDGI, the SNRs 
for different thresholds against the number of frames are 
given in Fig. |U It is evident that as the threshold k in- 
creases, the SNR increases faster, but is limited by the 
number N k + of reference frames available for averaging. 
As the computational time is approximately proportional 
to the number of frames, our TCDGI method is able to 
retrieve an image of better quality than DGI but with 
much less data manipulation and computing time. It is 
interesting that the SNR curves all exhibit some slight 
oscillations, as also observed in Ref. [l5j . To our knowl- 
edge, this is partly due to experimental errors, and partly 
because the information in the CCD matrix frames is ac- 



tually redundant for retrieving the object. 
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FIG. 4: (Color online) SNRs of DGI and TCDGI of different 
thresholds against the number of frames. 

So far there are few GI experiments on objects with 
continuously changing gray tones, due to the immense 
number of exposures required. The mask that we used in 
the second experiment is the well-known photo of Lena 
that is widely used in traditional image processing tests. 
The images obtained by different methods are shown in 
Fig. [SI and their corresponding SNRs in the Table. We 
can see clearly that, for the same number of frames, the 
images retrieved by DGI (upper row) are inferior in qual- 
ity to those retrieved by TCDGI (lower row). Moreover, 
with only 7600 exposures, we can still distinguish the 
TCDGI image in Fig. [5(i)| while the DGI image from 
8000 frames (Fig. |5(d)| , is almost drowned in the noise. 
It is interesting that the maximum SNR value of 2.49, 
obtained by TCDGI, (1.95 for DGI) is not g iven by the 
highest number of exposures (69000 x 2 in Fig. 5(e) which 
has an SNR of 2.43) but by 35400 x 2 exposures (Fig. 
[5(f)] ); the reason for this is, however, unclear at present, 
and deserves further analysis. 




FIG. 5: (a) Digital mask of Lena. Upper row: DGI images 
from (b) 140000, (c) 71000, (d) 8000 frames. Lower row: 
TCDGI images from (e) 69000 x 2, (f) 35400 x 2, (g) 3800 x 2 
frames for k = 1, 2 and 3, respectively. 

In conclusion, we have presented a new imaging tech- 
nique called TCDGI by which we can retrieve the image 
of an object through conditional averaging of the spatial 
intensity together with inversion of the negative signals, 
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TABLE I: SNR of the images in Fig. [5] 



Mask 


DGI 


TCDGI 


5(a) 


5(b) 


5(c) 


5(d) 


5(e) 


5(f) 


5(g) 


oo a 


2.10 


1.95 


0.75 


2.43 


2.49 


1.65 



a SNR of the mask is infinite, in accordance with Eq. 110t . 



time. It is shown that the major contributions to the re- 
trieved image come from the exposures with the largest 
intensity fluctuations. We believe that this new tech- 
nique, which combines the advantages of CI and DGI, 
may become a standardized method in real applications 
where conventional imaging and GI protocols do not work 
well. 



using only the reference detector data. This method can 
dramatically enhance the SNR compared with conven- 
tional GI and CI, especially for objects with rich gray 
tones. Moreover, under the same conditions but with 
appropriate choice of threshold values, the retrieved im- 
age can be better than DGI, whilst being simpler to pro- 
cess, and requiring less data manipulation and computing 
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